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DETAILED ACTION 
Prosecution History 

On 21 December 2001 , applicant filed the instant application. Applicant claims 
priority to provisional application 60/325559, filed 1 October 2001 . 

On 3 April 2003, the application was published as PG-PUB 20030065578. 

On 1 April 2005, the Examiner issued a requirement for Election/Restriction. 

On 2 May 2005, applicant elected to prosecute claims 1, 2, 18, 19 and 20 with 
traverse. 

On 14 July 2005, the Examiner issued rejection of claims 1,2, 18, 19 and 20. 

On 6 August 2007, the Examiner issued a non-final rejection of claims 1-72, 
having vacated the restriction requirement and the rejection of 14 July 2005. 

On 31 October 2007, applicant filed arguments. No claims were amended. 

On 28 January 2008, the Examiner issued a final rejection of claims 1-72. 

On 28 March 2008, applicant filed a request for reconsideration. 

The present office action vacates the finality of the Office Action of 28 January 
2008 and responds to applicant's arguments. 



Response to Request for Reconsideration. 

The request for reconsideration of 03/28/2008 is persuasive. The finality of the 
prior office action is withdrawn. 

Rejections under 35 USC 1 12 are withdrawn in view of applicant's comments 
and their implications. 
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No claims have been amended during prosecution. 

Claims 1-72 are pending and will be examined. 

Claim Rejections - 35 USC § 102 

The text of those sections of Title 35, U.S. Code not included in this action can 
be found in a prior Office action. 

Claims 1-10, 13-17, 21-22, 25, 27-44, 47-55, 58, 60-72, as interpreted, and in 
view of applicant's comments, are rejected under 35 U.S.C. 102(e) as being anticipated 
by Voticky etal. (US 6801216). 

As per claim 1 , Voticky discloses selecting beauty products, including: 

accessing a facial image. See, for example, references to various picture images, 
as in Fig. 9 and related text. 

receiving from the user a selection of at least one beauty product for simulated 
application to the facial image. See, for example, at least Fig. 10 and related text, 
concerning selection references 222 and 224. 

simulating the at least one selected beauty product on the facial image. See, for 
example, at least Fig. 9 and references to overlays, as in an "After picture." 

determining a recommended beauty product based at least in part on the at least 
one selected product. See, for example, at least Col. 11, lines 26-53, concerning 
product suggestions and recommendations. 

simulating the at least one recommended beauty product on the facial image. 
See, for example, at least Fig. 9, overlay images, "after picture". 
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As per claim 2, Voticky discloses causing the facial image to be displayed to the 
user. See, for example, at least Fig. 9 and related text. 

As per claim 3, Voticky discloses that the recommended beauty product is 
simulated on the facial image while the simulation of the at least one selected product 
appears on the facial image. See, for example, at least Col. 11, lines 26-37. 

As per claim 4, Voticky discloses that causing the facial image to be displayed 
includes providing software that facilitates display of the facial image. See, for example, 
at least Col. 1, lines 18-42. 

As per claim 5, Voticky discloses that the facial image is an image of the user's 
face. See, for example, references to picture of a person, as in Col. 1 , lines 33-51. 

As per claim 6, Voticky discloses processing an initial facial image in a manner 
to thereafter permit simulated application of a beauty product to a selected portion of the 
facial image. See, for example, at least Col. 1 1 , lines 6-20, which allows for selective 
application to various portions of the image. 

As per claim 7, Voticky discloses receiving from the user an affirmative request 
seeking a recommendation, and wherein the simulation of the recommended product 
appears on the facial image after the user affirmatively seeks a recommendation. See, 
for example, at least Col. 1 1 , lines 26-37. 

As per claim 8, Voticky discloses that the request identifies at least one of a 
brand, price, store, and product characteristic. See, for example, at least Col. 10, lines 
8-16 and references to selection of product lines. See also references to manufacturer, 
as in Col. 11, lines 28-53. 
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As per claim 9, Voticky discloses displaying a button activatable to cause a 
recommendation to be displayed. See, for example, at least Col. 3, lines 32-40. 

As per claim 10, Voticky discloses sequentially simulating alternative 
recommendations. See, for example, at least Col. 9, lines 16-29. 

For claims 11-12, see 103 rejection. 

As per claim 13, Voticky discloses that the recommended product is 
complementary to the selected product, and maintaining a data structure identifying 
products, and wherein determining a recommended beauty product is accomplished by 
accessing the data structure. See, for example, at least Col. 8, line 61 -Col. 9, line 14. 

As per claim 14, Voticky discloses that the data structure is populated with 
information derived from at least one of advice of beauty experts, user preference data, 
user purchase history, and survey data. See, for example, references to professional 
version, as in Fig. 4. 

As per claim 15, Voticky discloses eliciting personal information from the user, 
wherein the recommendation is a function of both at least one selected product and the 
personal information, (see at least references to a user's face, as in Col. 7, lines 21-30). 

As per claim 16, Voticky discloses that personal information includes at least 
one of age, skin type, skin texture, skin tone, wrinkles, hair color, hair style, hair 
condition, eye color- allergies, facial features, demographics, user preferences, and 
purchase history. (See, for example, at least Col. 1 , lines 33-51 ). 
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As per claim 17, Moticky discloses providing the user with an ability to select a 
basis for a recommendation, the basis being at least one of consumer survey data, 
consumer buying preferences, and expert advice (See, for example, Fig.4 and related 
text, concerning professional and customer versions). 

For Claims 18-20, see 1 03 rejection. 

As per claim 21 , Voticky discloses a network environment, wherein accessing 
the facial image and receiving the user selection occur via a network and in at least one 
location remote from a location of the user. See, for example, at least Fig. 1 and related 
text concerning network. 

Claim 22, an independent claim, is rejected on the same grounds as claim 1 . 

For Claims 23-24, see rejection under 103. 

As per claim 25, Voticky discloses providing the user with an option to trigger a 
simulation includes providing the user with an option to trigger a simulation of both the 
selected beauty product and the complementary beauty product. See at least 
references to selecting pictures, as in Col. 2, lines 17-40. 

For Claim 26 see 103 rejection, below. 

Claim 27 is rejected on the same grounds as claim 10. 

As per claim 28, Voticky discloses providing the user with an option to change a 
color of the selected beauty product. See, for example, at least Col 10, lines 8-24. 

As per claim 29, Voticky discloses providing users with options to change a 
color of complementary beauty product. See, for example, at least Col 10, lines 8-24. 
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As per claim 30, Voticky discloses that the option to change the color is based 
on at least one of a color bar, color palette, progressive color adjuster, and textual entry. 
See, for example, at least Col. 10, lines 8-24. 

As per claim 31 , Voticky discloses that the facial image includes at least one of 
a photograph, simulation, and graphical representation. See, for example, at least Fig. 
10 and related text, and other references to graphic layers and picture. 

Claim 32 is rejected on the same grounds as claim 21 . 

As per claim 33, Voticky discloses receiving a request from the user for an 
alternative complementary product recommendation. See at least Col. 8, lines 5-141 
Claim 34 is rejected on the same grounds as claim 22. 

As per claim 35, Voticky discloses providing the user with an option to change a 
color of at least one of the selected beauty product, the recommended complementary 
beauty product, and the alternative complementary product. See, for example, at least 
Col 10, lines 8-24. 

Claim 36, an Independent claim, is rejected on the same grounds as claim 1 . 

Claim 37 is rejected on the same grounds as claim 3. 

Claim 38 is rejected on the same grounds as claim 4. 

Claim 39 is rejected on the same grounds as claim 5. 

Claim 40 is rejected on the same grounds as claim 6. 

Claim 41 is rejected on the same grounds as claim 7. 

Claim 42 is rejected on the same grounds as claim 8. 

Claim 43 is rejected on the same grounds as claim 9. 
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Claim 44 is rejected on the same grounds as claim 10. 

For claims 45-46, see 103 rejection. 

Claim 47 is rejected on the same grounds as claim 13. 

Claim 48 is rejected on the same grounds as claim 14. 

Claim 49 is rejected on the same grounds as claim 15. 

Claim 50 is rejected on the same grounds as claim 16. 

Claim 51 is rejected on the same grounds as claim 17. 

As per claim 52, Voticky discloses that the display presents two facial images, 
and wherein differing recommended products are displayed on each image. See at least 
Col. 8,lines 4-23. 

As per claim 53, Voticky discloses that multiple facial images are simultaneously 
displayed. For example, Col. 8, lines 4-23. 

As per claim 54, Voticky discloses that the simulator visually simulates a 
differing combination of beauty products on each facial image. See, for example, at 
least Col. 8, line 61 -Co1 .9, line 28. 

Claim 55, an independent claim, is rejected on the same grounds as claim 1 . 

For Claims 56-57, see 103 rejection, below. 

Claim 58 is rejected on the same grounds as claims 22 and 25. 

For Claim 591 see 103 rejection, below. 

Claim 60 is rejected on the same grounds as claim 27. 

Claim 61 is rejected on the same grounds as claim 28. 

Claim 62 is rejected on the same grounds as claim 29. 
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Claim 63 is rejected on the same grounds as claim 30. 

Claim 64 is rejected on the same grounds as claim 31 . 

Claim 65 is rejected on the same grounds as claim 33. 

Claim 66 is rejected on the same grounds as claim 35. 

As per claim 67, Voticky discloses a storage location for storing the facial image. 
See, for example, at least Fig. 2 and related text. 

Claim 68, an independent claim, is rejected on the same grounds as claim 1 . 

As per claim 69, Voticky discloses that the personal information includes an 
image of the user on which the simulating occurs. See, for example, at least Fig. 10 and 
related text, and other references to graphic layers and picture. 

As per claim 70, Voticky discloses processing the image of the user to 
determine facial characteristics, and wherein determining takes into account the facial 
characteristics. See, for example, at last Col. 1 1 , lines 21 -25. 

Claim 71 is rejected on the same grounds as claim 21 . 

Claim 72 is rejected on the same grounds as claim 1 . 

Claim Rejections - 35 USC § 103 

The text of those sections of Title 35, U.S. Code not included in this action can 
be found in a prior Office action. 

Claims 11-12, 18-20, 26, 45, 46, 59 are rejected under 35 U.S.C. 103(a) as 
being unpatentable over Voticky, above, in view of Orpaz et al. (US 6937755). 
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As per claim 1 1 , Voticky discloses causing the facial image to be displayed to 
the user (See, for example, at least Fig. 12 and related text). Voticky does not 
specifically disclose that a first alternative simulated recommendation is displayed 
simultaneously on the facial image with a display of the at least one selected product 
and wherein thereafter a second alternative simulated recommendation is displayed 
simultaneously on the facial image with a display of the at least one selected product. 

This feature is disclosed by Orpaz, Fig. 4 and related text, as in Col. 4, lines 37- 
50. It would have been obvious to one of ordinary skill in the art at the time the invention 
was made to combine Voticky and Orpaz to disclose that a first alternative simulated 
recommendation is displayed simultaneously on the facial image with a display of the at 
least one selected product, and wherein thereafter a second alternative simulated 
recommendation is displayed simultaneously on the facial image with a display of the at 
least one selected product. 

One of ordinary skill in the art at the time the invention was made would have 
been motivated to combine Voticky and Orpaz to disclose that a first alternative 
simulated recommendation is displayed simultaneously on the facial image with a 
display of the at least one selected product, and wherein thereafter a second alternative 
simulated recommendation is displayed simultaneously on the facial image with a 
display of the at least one selected product for the obvious reason that a customer may 
wish to view various looks at the same time and because the incorporation of such 
features is no more than the predictable use of prior art elements according to their 
established function. 
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Claim 12 is rejected on the same grounds as claim 1 1 . 

Claim 18 is rejected on the same grounds as claim 1 1 . 

Claim 19 is rejected on the same grounds as claim 11. 

As per claim 20, Voticky discloses that each facial image has a differing 
combination of beauty products simulated thereon. See, for example, at least Col. 8, 
line 61 -Col. 9, line 15). 

Claim 26 is rejected on the same grounds as claim 1 1 . 

Claim 45 is rejected on the same grounds as claim 1 1 . 

Claim 46 is rejected on the same grounds as claim 12. 

Claim 59 is rejected on the same grounds as claim 1 1 . 

Claims 23-24. 56-57 are rejected under 35 U.S.C. 103(a) as being 
unpatentable over Voticky, Orpaz and admitted prior art. 

Wicky and Orpaz do not specifically disclose the use of Artificial Intelligence. 

As admitted prior art., it was old and well know at the time the invention was 
made to analyze historical data to provide guidance concerning consumer preferences. 

It would have been obvious to one of ordinary skill at the time the invention was 
made to combine Voticky, Orpaz and knowledge of one of ordinary skill to disclose 
identifying a complementary product is performed using an artificial intelligence engine 
(as in claims 23 and 56) and to disclose .that the artificial intelligence engine is based 
on at least one of a neural network, constraint program, fuzzy logic, classification, 
conventional artificial intelligence, symbolic manipulation, fuzzy set theory, evolutionary 
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computation, cybernetics, data mining, approximate reasoning, derivative-free 
optimization, and soft computing (claims 24 and 57). 

One of ordinary skill at the time the invention was made would have been 
motivated to combine Voticky, Orpaz and knowledge of one of ordinary skill to disclose 
identifying a complementary product is performed using an artificial intelligence engine 
(as in claims 23 and 56) and to disclose .that the artificial intelligence engine is based 
on at least one of a neural network, constraint program, fuzzy logic, classification, 
conventional artificial intelligence, symbolic manipulation, fuzzy set theory, evolutionary 
computation, cybernetics, data mining, approximate reasoning, derivative-free 
optimization, and soft computing (claims 24 and 57) for the obvious reason that by 
having information concerning consumer preferences, a company is better able to serve 
the public, and be able to provide a powerful and persuasive marketing tool and 
because the incorporation of such features is no more than the predictable use of prior 
art elements according to their established function. 

Response to Arguments 

This response clarifies prior rejections. 

Applicant introduces Hurst an external reference. The Examiner directs 
applicant to MPEP 609 for Information Disclosure Statements and submission of 
references. 
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Applicant introduces Hurst, an external reference. The Examiner directs 
applicant to MPEP 609 for Information Disclosure Statements and submission of 
references. 

Applicant argues, 

Applicants submit that the term "conventional artificial intelligence," as understood in the 
art, refers to a subfield of artificial intelligence, which is based on machine learning and 
concerned with techniques and algorithms that allow machines to learn or at least 
simulate learning. This is evidenced by the attached article titled "Overview and Tutorial 
on Artificial intelligence Systems" by Jim Hurst 

(www.giac.org/resources/whitepaper/application/237.php) ("Hurst") at p. 2. Examples of 
"conventional artificial intelligence," as that term is understood in the art, include case- 
based reasoning, behavior-based artificial intelligence, Bayesian networks, and expert 
systems. Id. Page 4) 

In response, Hurst admits lack of definiteness: 

Defining artificial intelligence is somewhat controversial, because there is no single 
definition of intelligence . . . 

The artificial intelligence community can be roughly divided into two schools of 
thought: conventional Al and computational intelligence. (Request 03/28/2008, page 14) 

Artificial intelligence is not a single thing ; it is many things... 

. . . there is no widespread agreement on exactly what artificial intelligence is. (Request 
03/28/2008, page 19) 

Applicant argues, 

...[ejxaminer appears to have misunderstood the meaning of the term "conventional 
artificial intelligence." Office Action at 4. The Examiner appears to have interpreted the 
term "conventional," as an adjective that describes "artificial intelligence" as being 
conventional. Id. (Page 4) 

Hurst does not mention the term artificial intelligence engine. Applicant has 

vigorously asserted the distinction between (a) artificial intelligence and (b) artificial 

intelligence engine. For example, 

Claims 23, 24, 56, and 57 refer not merely to artificial intelligence but to an artificial 
intelligence engine, w hich is described throughout the specification in such a way as to 
enable one skilled in the art to make and/or use the invention, and in such a way as to 
reasonably convey to one skilled in the relevant art that the inventors had possession of 
the claimed invention... Contrary to the assertion in the Office Action at page 4, the 
portion of the specification identified by the Examiner has much more than just a brief 
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mention of the term " artificial intelligence engine" (Al engine) (10/31/2007, page 6, 
emphasis added) 

Applicant relies on Hurst (pp 14-19) for support terms that applicant claims are 
". . .understood in the art. .." 



Applicants submit that the term "conventional artificial intelligence," as understood in the 
art, refers to a subfield of artificial intelligence, which is based on machine learning and 
concerned with techniques and algorithms that allow machines to learn or at least 
simulate learning. This is evidenced by the attached article titled "Overview and Tutorial 
on Artificial intelligence Systems" by Jim Hurst 
(www.qiac.org/resources/whitepaper/application/237.php ) 

Hurst also clearly admits that conventional Al is already successful and well 

known in several areas: 

Conventional Al has achieved success in several areas. Expert systems, or knowledge- 
based systems, attempt to capture the domain expertise of one or more humans and 
apply that knowledge... Expert systems are used in many fields, including finance, 
medicine, and automated manufacturing... (Request 03/28/2008, page 16) 

All these techniques have successful applications in use today. Artificial intelligence is 
improving our lives in numerous ways, even when there is no widespread agreement on 
exactly what artificial intelligence is. (Request 03/28/2008, page 19) 

Applicant argues that one of ordinary skill would understand that what he labels 
as "...artificial intelligence [engine]..." are known to one of ordinary skill in the art. 
In response, the Examiner notes 

...Where an explicit definition is provided by the applicant for a term, that definition will 
control interpretation of the term as it is used in the claim. Toro Co. v. White 
Consolidated Industries Inc., 199 F.3d 1295, 1301, 53 USPQ2d 1065, 1069 (Fed. Cir. 
1999) (meaning of words used in a claim is not construed in a "lexicographic vacuum, 
but in the context of the specification and drawings."). Any special meaning assigned to 
a term "must be sufficiently clear in the specification that any departure from common 
usage would be so understood by a person of experience in the field of the invention." 
Multiform Desiccants Inc. v. Medzam Ltd., 133 F.3d 1473, 1477, 45 USPQ2d 1429, 
1432 (Fed. Cir. 1998). See also MPEP §2111.01. 

• During prosecution, claims are given their broadest reasonable interpretation: 

USPTO personnel are to give claims their broadest reasonable interpretation in light of the 
supporting disclosure. In re Morris, 127 F.3d 1048, 1054-55, 44 USPQ2d 1023, 1027-28 
(Fed. Cir. 1997). Limitations appearing in the specification but not recited in the claim 
should not be read into the claim. E-Pass Techs., Inc. v. 3Com Corp., 343 F.3d 1364, 
1369, 67 USPQ2d 1947, 1950 (Fed. Cir. 2003) (claims must be interpreted "in view of the 
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specification" without importing limitations from the specification into the claims 
unnecessarily). In re Prater, 415 F.2d 1393, 1404-05, 162 USPQ 541, 550- 551 (CCPA 
1969). See also In re Zletz, 893 F.2d 319, 321-22, 13 USPQ2d 1320, 1322 (Fed. Cir. 
1989) ("During patent examination the pending claims must be interpreted as broadly as 
their terms reasonably allow.... The reason is simply that during patent prosecution when 
claims can be amended, ambiguities should be recognized, scope and breadth of 
language explored, and clarification imposed.... An essential purpose of patent 
examination is to fashion claims that are precise, clear, correct, and unambiguous. MPEP 
2106. 

Although applicant's specifications contain several mentions of the various 
claimed terms, applicant provides no explicit definitions. Examples found "...throughout 
the specification..." are not definitions. 

Further, it has been found "That a person skilled in the art might realize from 
reading the disclosure that such a particular definition (as now argued) is a possible 
definition is not a sufficient indication to that person that that particular definition is part 
of Applicant's invention as originally filed. Claims yet unpatented are to be given the 
broadest reasonable interpretation consistent with the specification during the 
examination of a patent application. In re Prater, 415 F.2d 1393, 162 USPQ 541 (CCPA 
1969). In the instant case, Applicant has not persuasively demonstrated that the 
Examiner has applied an unreasonable interpretation of the recited feature, that the 
interpretation is inconsistent with the specification, or that applied interpretation is 
repugnant to one of ordinary skill in the art. 

An engine is the portion of a program that determines how the program manages 
and manipulates data. MICROSOFT PRESS Computer Dictionary. An "...artificial 
intelligence engine..." according to applicants, does not always encompass "...artificial 
intelligence..." Thus, the label "... artificial intelligence..." that precedes the noun 
appears also to be non-functional descriptive material. 
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For purposes of Examination, the terms and their derivatives will be interpreted to 
include any type of computer instruction that includes artificial intelligence and that does 
not include artificial intelligence. The term artificial intelligence engine is interpreted to 
mean portion(s) of a program that determines how the program manages and 
manipulates data, where the portion of the program may include examples of what 
applicant calls artificial intelligence and where the portion of the program may exclude 
what applicant calls artificial intelligence. 



Official Notice and Traverse 

A "traverse" is a denial of an opposing party's allegations of fact. (Black's Law 
Dictionary, "In common law pleading, a traverse signifies a denial.") 
Applicant merely states: 

The Examiner took Official Notice, .asserting that "it was old and well know[n] at the time 
the invention was made to analyze historical data to provide guidance concerning 
consumer preferences." 

Even if the Examiner's assertion were true, a notion which Applicants respectfully 
dispute.. 

Applicants' arguments do not traverse what Examiner regards as knowledge that 
would have been generally available to one of ordinary skill in the art at the time the 
invention was made. 

Even if one were-to interpret applicants' statements as constituting a traverse, 
one would still be faced with the inquiry as to whether the traverse is adequate. An 
adequate traverse must contain adequate information or argument to create on its face 
a reasonable doubt regarding the circumstances justifying Examiner's notice of what is 
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well known to one of ordinary skill in the art. In re Boon, 439 F.2d 724, 728, 169 USPQ 
231, 234 (CCPA1971). Applicant's traverse is not adequate. 

If applicant does not seasonably traverse the well known statement during 
examination, then the object of the well known statement is taken to be admitted prior 
art. In re Chevenard, 139 F.2d 71,60 USPQ 239 (CCPA 1943). MPEP 2144.03 Reliance 
on Common Knowledge in the Art or "Well Known" Prior Art. 

In view of applicant's failure to adequately traverse official notice, the following 
are admitted prior art: it was old and well known at the time the invention was made to 
analyze historical data to provide guidance concerning consumer preferences. 

Conclusion 

THIS ACTION IS MADE FINAL. Applicant is reminded of the extension of time 
policy as set forth in 37 CFR 1 .136(a). 

A shortened statutory period for reply to this final action is set to expire THREE 
MONTHS from the mailing date of this action. In the event a first reply is filed within 
TWO MONTHS of the mailing date of this final action and the advisory action is not 
mailed until after the end of the THREE-MONTH shortened statutory period, then the 
shortened statutory period will expire on the date the advisory action is mailed, and any 
extension fee pursuant to 37 CFR 1 .136(a) will be calculated from the mailing date of 
the advisory action. In no event, however, will the statutory period for reply expire later 
than SIX MONTHS from the mailing date of this final action. 
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Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to JAMES ZURITA whose telephone number is (571 )272- 
6766. The examiner can normally be reached on 8am-5pm. 

If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, Jeffrey A. Smith can be reached on (571)272-6763. The fax phone number 
for the organization where this application or proceeding is assigned is 571-273-8300. 

Information regarding the status of an application may be obtained from the 

Patent Application Information Retrieval (PAIR) system. Status information for 

published applications may be obtained from either Private PAIR or Public PAIR. 

Status information for unpublished applications is available through Private PAIR only. 

For more information about the PAIR system, see http://pair-direct.uspto.gov. Should 

you have questions on access to the Private PAIR system, contact the Electronic 

Business Center (EBC) at 866-217-9197 (toll-free). If you would like assistance from a 

USPTO Customer Service Representative or access to the automated information 

system, call 800-786-9199 (IN USA OR CANADA) or 571-272-1000. 

/JAMES ZURITA/ 
Primary Examiner 
AU 3625 
04/14/2009 



